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Abstract 


There are different dimensions of the quality of education that have a distinctive role and 
importance for the preview of the basic features of education quality. In this paper, effectiveness 
in education is considered as one of the key dimensions of the quality of education, which will be 
seen also as economic category. In order to clarify conceptualization of the quality of education, 
main differences in the meaning of the terms efficiency and effectiveness in education were 
highlighted. System and process characteristics of education were emphasized, and based on 
these two distinguishing features of education, the specificity of evaluation of effectiveness in 
education were accentuated. In this paper, main characteristics of assessment of overall 
effectiveness in some fields of education, including assessment of effectiveness in particular 
segments (teaching, learning, usage of different methods and organizational forms, assessment 
in teaching, etc.). Different characteristics of constitution of the teaching effectiveness’ evaluation 
model, and the potential dilemmas and difficulties during these processes were discussed. 


Keywords: quality of education, efficiency of education, effectiveness of education, effectiveness 
evaluation model. 


1. Introduction 


Different approaches in studying the quality of education exist, as a series of significant 
characteristics (dimensions) that occur within the educational process. Differences in the ways of 
studying the quality of education are conditioned by the settings that arise in the theoretical 
starting points that serve as the basis of theoretical analysis. In most cases, the starting point for 
determining the essence of quality of education is the answers to two important questions: (1) 
what is the quality of education, and (2) what does the content of quality of education mean? 
(Anderson, 2012). In accordance with the theoretical orientation, which is the basis of asking for 
answers to these questions, a certain way of conceptualizing the quality of education is constituted, 
as well as everything that makes the content of the quality of education. This is expressed by the 
description of certain dimensions of the quality of education that are considered significant, 
describing the basic constitutive characteristics of the quality of education, the description of 
factors of quality of education, as well as in other ways. 


There are also some other approaches in regard to the quality of education. One of 
these approaches refers to the consideration of quality of education’ factors. For example, 
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according to one UNICEF document, when considering the basic children’s rights, it states that 
quality of education includes the following (Definition quality ..., 2000): 


e Learners who are healthy, well-nourished and ready to participate and learn, and 
supported in learning by their families and communities; 


e Environments that are healthy, safe, protective and gender-sensitive, and provide 
adequate resources and facilities; 


e Content that is reflected in relevant curricula and materials for the acquisition of 
basic skills, especially in the areas of literacy, numeracy and skills for life, and 
knowledge in such areas as gender, health, nutrition, HIV/AIDS prevention and 
peace. 


e Processes through which trained teachers use child-centered teaching 
approaches in well-managed classrooms and schools and skilful assessment to 
facilitate learning and reduce disparities. 


e Outcomes that encompass knowledge, skills and attitudes, and are linked to 
national goals for education and positive participation in society. 


In our paper, special attention will be paid to the effectiveness of education 
(effectiveness in education, education effectiveness) as one of the undoubtedly significant 
dimensions of the quality of education, and it particularly relates to the effectiveness of teaching 
as a whole, as the most organized form of education. Therefore, we will pay attention to a 
phenomenon that can be labeled as the overall effectiveness of teaching, which can be seen 
through the effectiveness that appears as a phenomenon and can be examined in different areas 
of teaching. 


Potentially, an integral approach to improving the quality of education refers to a set 
of different efforts to improve the level of overall quality of education through improvements 
designed and implemented within the specific dimensions of the quality of education (Anderson, 
2012). This implies the creation of an approach needed to synchronize adequately the changes that 
relate to the improvement of the basic features of education, thus achieving the improvement of 
the general level of quality in education. 


When considering the essential characteristics of the effectiveness of education as one 
of the dimensions of quality of education, it is necessary to point out the existence of a complex 
relationship between the efficiency of education and the effectiveness of education. Within the 
wider consideration of the problem of assessing the quality of education, it is necessary to 
determine whether there are and what constitutes the key elements of differences between these 
two dimensions of the quality of education. For the purpose of analysis undertaken in this paper, 
the general characteristics of the relationship between these two dimensions of quality of 
education will be pointed out. In general, efficiency and effectiveness are terms that are often in 
everyday use, in all areas of professional activity and in everyday life of people. In that sense, it is 
necessary to start from the most general meanings of these terms and differences that exist in their 
use. 


2. Efficiency of education 


Efficiency in general can be related to the way in which a system operates, as the level 
of interdependence between the functioning of certain parts of the system structure, in relation to 
the structure as a whole. Starting from the fact that there are different approaches in determining 
the relationship between the terms of “structure” and “system”, in this case, the system will be 
considered as a particular structure with the operating modes that are realized within this 
structure. If systems can be conditionally classified into spontaneous and non-spontaneous 
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systems, then in this respect we will consider efficiency in the first place as a property of a non- 
spontaneous system, that is, one that is pre-planned and organized, as a system of human creation. 
In addition to this general classification, non-spontaneous systems can be classified into static and 
dynamic systems, as well as technical and social systems. All these systems are distinguished by 
the presence of a certain level of optimization of the system’s functioning, so that the efficiency of 
system can be considered as the optimal functioning of system. Similarly, in addition to the 
functioning of whole system, the efficiency also refers to the optimality of functioning of each 
individual element in the system, the mutual compliance of these functions, and the role and 
function of each individual element for the optimal functioning of system as a whole. 


It should be emphasized that in the case of such a way of determining the meaning of 
term “efficiency”, that is, the efficiency of system as an optimality in the system functioning, it is 
also necessary to determine the meaning of term “optimality”, i.e. “optimality of functioning”. This 
could be also applied to systems that are constituted in the field of education (education system, 
school system, teaching system, system of evaluation in education, and others). If that were not 
done, we would have come to the situation of trying to determine an unspecified phenomenon by 
another, also unspecified phenomenon. In order to clarify the meaning of terms such as 
“optimality”, “optimum” and “optimal”, we will point out three different levels (modes) of 
functionality of any system: (1) the real functionality of the system, (2) the complete functionality 
of the system, and (3) the best possible functionality of the system. 


The first mode of functionality relates to a real state of the functioning of whole system 
and its particular parts. This includes simultaneous presence and high level of functionality, but 
there may also be various functional shortcomings, different types of disfunction, mutual 
mismatch in the functioning of certain elements in the system, etc. This is characteristic for the 
systems where there is a lower level of efficiency of the system’s functioning. For example, in the 
teaching when a teacher presents new material, there is a real situation of achieving a certain level 
of efficiency in the transfer of knowledge, definitions, explanations, different data, etc. 
(information transfer). In addition, each student receiving information from teacher makes it at a 
different level of acquisition efficiency, so it can be expected that better students adopt the full 
range of transferred information, and that other students receive information on a smaller scale, 
based on a lesser capacity to fully understand what teacher transfers. 


The second mode is characteristic for the high-precision systems, for example, for 
technical, technological and information systems, which implies that there should be complete 
functionality without interferences, as a condition for the existence of a system. For example, the 
functionality of a system in this sense is an algorithm of a computer program in which each of the 
program implementation’ elements must have full functionality, otherwise the program will not 
work at all. Systems of this level of exactness and functionality cannot be realized in the social 
environment, in the case of social systems. In this area, complete functionality is usually only an 
ideal state of the system’ functioning and its elements, it is a condition that is trying to achieve, 
but it cannot be fully realized. 


The third mode is characteristic of systems in which the internal functions of system 
are at the best possible level of functioning and this way of functioning of the system can be labeled 
as optimal functioning. So, in addition to having an ideal state of functioning, one can also talk 
about this mode of operation, in which there is the best possible level of functioning, which we can 
label as optimal functioning. And in this work under the “optimal state” we mean the “best possible 
state” of functioning of a system. 


In the field of different social systems, we consider that efficiency refers to the level of 
optimality in the functioning of a social structure, which consists of certain elements, their 
particular functions, mutual relations and the way of functioning of the whole structure as a 
system. Efficiency also refers to the optimality of process (level of optimality), which especially 
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refers to the processes of social and interpersonal character, and especially to those whose 
implementation is part of some previous conceptualization and planning. In general, the efficiency 
of process can be determined as the optimality of process, of the whole as well as of the specific 
parts of process (sub-processes) that are part of that whole. For a pre-planned and organized 
process of social character, it can be considered to be effective if each subsequent phase in the 
process represents, as far as possible, if there is the unimpeded optimum movement towards a 
predicted outcome (effect) of the process. This also applies to the way in which specific processes 
are carried out within the whole of a process. An example of this is teaching as a general process, 
while learning and learning in the classroom are particular processes that take place within the 
whole process of teaching. 


3. Effectiveness of education 


Effectiveness as a phenomenon is closely related to the emergence of efficiency and it 
is only conditionally possible to separate these two dimensions of the education quality. On the 
other hand, the confusion of these two concepts is present. In principle, effectiveness of education 
refers to the results that are achieved in the process of education, and represent the relationship 
between those results and all that is undertaken in education. In other words, the effectiveness, 
when it can be determined in an objective way, is a measure of the effects of some realized activities 
in the process of education (Lockhead & Hanushek, 1994). Also, the significant fact about the 
effects of education refers to the sustainability of a progressive change in a student’s competence, 
or whether it is a change that may have a more or less lasting effect. 


In this paper, we accept the view that effectiveness of education refers primarily to the 
result (outcome, effect) that is realized in a certain area of functioning of the system, or in the 
realization of a process (Kovaé Cerovic, 2004). However, it must be emphasized that in this case 
the economic perception of the phenomenon of effectiveness prevailed, which implies the 
perception of effectiveness as the relationship between the invested financial means and the 
achieved results. Regardless of the fact that the economic (financial) framework represents a 
significant factor in the success of education system’ functioning, the effectiveness of education as 
a phenomenon needs to be viewed in a wider context, but also deeper and more comprehensive, 
through the complexity of education system, the way of functioning of the whole of that system 
and its specific parts, and the synchronization of the special processes in the system. In general, 
efficiency and effectiveness in education can be seen as complementary phenomena, but in this 
way the effectiveness of education refers to the outcomes of functioning of various systems and 
the realization of various processes in the field of education. 


In the most general sense, education as a whole is a process that, on the basis of its 
basic characteristics, also has certain specificities of the flow of process. And this process consists 
of specific and relatively separate processes, such as teaching process, learning process, student 
assessment process and others, which form an integral part of the whole education process and 
whose specific characteristics are conditioned by the characteristics of the education process as a 
whole. From this point of view, the problem of relationship between general and special processes 
in the field of evaluation of effectiveness in education needs to be considered. 


Evaluating the effectiveness of education is conditioned by several different factors. 
To the complexity of the problem of assessing effectiveness within the education system 
contributes the simple fact that students do not learn only at school, but at home and elsewhere, 
from different sources of learning (Lockhead & Hanushek, 1994). In fact, as well as adults, 
students also learn, develop and improve their cognitive and other capacities daily, through a 
variety of different learning situations, which exist in school and out of school. 
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If education and learning take place only at school, then a more exact model for 
evaluating the effectiveness of education could be constructed, which would relate to activities 
within the school curriculum. This model of assessment would include different parameters that 
are economic in nature and that can be related to the describing of financial values of different 
inputs, such as the following forms of investment: general-purpose school equipment, quality of 
learning space, school technological equipment (computers, Internet), initial teacher education, 
professional development and teacher training, students’ qualities, etc. All of these input fields can 
be exactly esteemed, so a precise level of general input can be provided, when it comes to a 
particular school. 


The problem of broader understanding of the effectiveness of education and learning, 
which would include learning at school and outside of school, consists in the fact that it is not 
possible to clearly divide in a more comprehensive way the segment of learning in the school, in 
relation to the learning appears out of school (Lockhead & Hanushek, 1994). In this regard, a 
number of different issues will be posed, which would be necessary to resolve, with the aim of 
constituting an objective model for assessing the effectiveness of education. The starting point 
should be at the very purpose of assessing, whether the model of assessment relates to the 
effectiveness of school education for a particular group (age) of students, or to the overall 
effectiveness of education (which would include education and learning that takes place both in 
school and outside the school). 


4. Model of the education effectiveness’ assessment 


The effectiveness of education can be assessed by both qualitative and quantitative 
approaches. A quantitative approach in assessing the effectiveness of education is necessary to be 
applied. For example, on the basis of organized systematic observation of the development of a 
segment of the teaching process, certain conclusions about effectiveness of the observed segment 
of teaching process can be carried out in qualitative terms, and without the help of means of 
quantitative assessment. In this respect, a qualitative approach to assessing, if applied without a 
comparative application of a quantitative approach, could have some disadvantages that would 
significantly reduce its value and objectivity. Therefore, in situations of comparative application 
both qualitative and quantitative approaches, some conditions for achieving a fuller and more 
precise assessment can be achieved. 


The design and implementation of quantitative (statistical) methods of measuring the 
level of effectiveness in an area of education is subject to the rules that need to be taken into 
account when choosing adequate procedures, choices that need to be made in accordance with the 
nature of effectiveness that is to be assessed (Kyriakides, 2006). In addition, instruments used to 
collect data to assess effectiveness in an area od education should meet key methodological 
criteria, which relate to reliability, validity, objectivity, and others. 


The basis for constituting a certain model of evaluation (measurement) of 
effectiveness in education is determining with the facts, what is being measured and how this could 
be most appropriately applied. When it comes to measuring the effectiveness of teaching, Berk 
(2005) points out precisely the need to start from these two questions in the process of building a 
model for assessing effectiveness, that is, what is measured and how could be measured. These are 
two interrelated and conditioned questions. It is undoubtedly that ways of measuring (how to 
measure?) will be directly dependent on what is measured in education. 


Regarding the field of measuring effectiveness in education, there are a number of 
different areas in which potential measurement can be conducted. For example, Berk (2005), 
discussing the possibilities of measuring the effectiveness of teaching, lists the following sources 
of effectiveness measurements in teaching: (a) student ratings, (b) peer ratings, (c) self-evaluation, 
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(d) videos, (e) student interviews , (f) alumni ratings, (g) employer ratings, (h) administrator 
ratings, (i) teaching scholarship, (j) teaching awards, (k) learning outcome measures, and (1) 
teaching portfolios. 


One of the simple statistical procedures and indicators that enable to run the 
effectiveness measure in education is to calculate the percentage of effectiveness. In the case of the 
application of this procedure, the starting point is the statistical logic of percentage as an 
assessment measure, which implies acceptance of the measure of 100%, as measure of maximum 
effectiveness, i.e. full effectiveness. However, in spite of the fact that it is statistically simple to 
perform the measure of effectiveness expressed in percent, there are certain dilemmas that need 
to be considered and resolved in an adequate way. Or, in other words, there is a problem of 
interpreting a certain statistical measure. 


Among other things, in some situations (but not necessarily) there can be a problem 
as the following: how from the statistical scale of quantitative description can also be constituted 
a model that enables the qualitative (descriptive) meanings of certain measures of the level of 
effectiveness in a segment of education (Bos, 2002). It is clear that the measure of 0% can be 
descriptively labeled as the absence of any level of effectiveness, while a 100% measure can be 
labeled as a level of total effectiveness. Thus descriptive levels and effectiveness sectors can be set 
up through the formulations of “minimum effectiveness”, “low effectiveness”, “mid-level 
effectiveness”, “high effectiveness”, “very high effectiveness”, and with the similar formulations. 
For all these descriptively expressed levels and sectors of effectiveness, there is a problem of 
determining the range of percentages to which they relate, that is, determining the lower and 
upper boundaries of the sector. For example, there may be a dilemma for determining the “low 
effectiveness” sector. Depending on which sectors are represented in some constituted model of 
describing the level of effectiveness, the range of this sector can go from 5 to 50%, or up to 60%. A 
similar dilemma may also arise when deciding on which percentage range the description refers 
to as “mid-level effectiveness”. It is assumed that the central part of that range should always be 
at the level of 50%, but the overall range may in some cases be determined to be between 45 and 
55%, while in some other cases it could be as high as 30 to 70%. 


Some of the dilemmas that arise in this area relate to the use of term “ineffectiveness” 
and the relation of this term to the term “effectiveness”. For example, can a low level of 
effectiveness in some area be marked as ineffectiveness? Is the measure of the lowest level of 
effectiveness (0%) an indicator that can be characterized as a complete ineffectiveness? Is 
ineffectiveness always unambiguously opposite phenomenon in relation to the phenomenon of 
effectiveness? Is there a real boundary between “effectiveness” and “ineffectiveness”? These are 
some of the most important issues concerning the relationship between these two phenomena. 
The complexity of relationship that exists between these two phenomena points to the differences 
that occur in their relationship, in different concrete situations of assessing the effectiveness in 
education, which also results in different theoretical and practical problems in constituting the 
model of describing the level of effectiveness (inefficiency) in examined area. The dilemma of this 
kind occurs in the significance of statistical indicators of students’ success in a certain field of work 
in teaching, at a certain age. In this case, it concerns the determination of the boundary between 
success and failure, or which would be the lowest level of achievement of the student under which 
any measure of achievement can be marked as a failure. 


Such and similar questions and dilemmas should be considered when constructing the 
model of estimation of effectiveness in a certain area of assessment, and they relate in principle to 
the interpretation of other statistical measures that serve as a quantitative means of assessing the 
level of effectiveness in some area of education, which is also present in so-called large scale 
(sample) studies (Bos, 2002). In addition to using percentages as a means of assessing 
effectiveness in some area of education, and other statistical procedures that belong to the 
descriptive statistics can find an adequate application for the implementation of estimation 
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measures for the levels of effectiveness. Among others, those are measures of arithmetic mean, 
standard deviation, coefficients of correlation and contingency, measures of statistical significance 
and others. In the case of application of the other statistical procedures for assessing the level of 
effectiveness, it is necessary to take into account and consider various dilemmas, in order to 
achieve a better quality of assessment. 


4. Conclusion 


Finding adequate approaches and permanent work on the establishment of different 
models of evaluating the efficiency and effectiveness of education, and in particular the efficiency 
and effectiveness of teaching, is one of the important tasks of pedagogy and economics of 
education in the studies of contemporary education, especially the forms of education that are 
organized through an institutionalized education system in each state and which is of general 
social interest. The basis for the existence of this task is the need for continuous improvement of 
the education quality, through the improvement of its various dimensions. It is undoubtedly that 
efficiency and effectiveness within the education system represent the dimensions that are crucial 
for achieving better level of quality of education as a whole. 
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